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Abstract 

We consider the class of closed generic fluid networks (GFN) models, 
which provides an abstract framework containing a wide variety of fluid 
networks. Within this framework a Lyapunov method for stability of GFN 
models was proposed by Ye and Chen. They proved that stability of a 
GFN model is equivalent to the existence of a functional on the set of paths 
that is decaying along paths. This result falls short of a converse Lyapunov 
theorem in that no state dependent Lyapunov function is constructed. In 
this paper we construct state-dependent Lyapunov functions in contrast 
to path-wise functionals. We flrst show by counterexamples that closed 
GFN models do not provide sufficient information that allow for a converse 
Lyapunov theorem. To resolve this problem we introduce the class of strict 
GFN models by forcing the closed GFN model to satisfy a concatenation 
and a semicontinuity condition of the set of paths in dependence of initial 
condition. For the class of strict GFN models we define a state-dependent 
Lyapunov and show that a converse Lyapunov theorem holds. Finally, it 
is shown that common fiuid network models, like general work-conserving 
and priority fiuid network models as well as certain linear Skorokhod 
problems define strict GFN models. 

1 Introduction 

An effective tool to model complex manufacturing systems, computer systems 
or telecommunication networks is the family of multiclass queueing networks. 
An example for this occurs in semiconductor fabrication, where production lines 
are modeled as reentrant lines, which are a special case of multiclass queueing 
networks. Especially in the pursuit of deriving good control strategies for mul- 
ticlass queueing networks the question of stability arises. For a long period a 
common belief was that a sufficient condition for stability is that the traffic in- 
tensity is strictly less then one. But in 1993 Kumar and Seidman [2^ presented 
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a network with two stations processing four types of jobs which is unstable 
although the traffic intensity at each station is less than one. This example 
inspired a number of examples with different service disciplines, like first-in- 
first-out (FIFO) and priority, that have surprising properties. In the literature 
they are known as the Lu-Kumar network, the Rybko-Stolyar network or the 
Bramson network, see e.g. [S] or [B], [T^] and [55]. In recent years further disci- 
plines like maximum pressure and join-the-shortest-queue are investigated |f 5] , 
[TT] , [IH] . Rybko and Stolyar [53] and Dai [T5] pursued the strategy of rescaling 
the stochastic processes that describe the dynamics of a multiclass queueing 
network and considered the limit obtained under scaling. This limit is called 
the fluid limit model for the queueing network and is a continuous deterministic 
model. Of course, deterministic models are much easier to investigate. The 
great benefit of this approach is, that the stability of the corresponding fluid 
limit model is sufficient for the stability of a multiclass queueing network [T5] . 
In addition, there are conditions for instability of queueing networks relative 
to their fluid limit model [T31 d?]. A discussion of the relationship between 
queueing networks and fluid models can be found in [B]. 

Due to this fact the question arises, under which conditions fluid limit models 
are stable. A fluid model is called stable if the fluid level process Q with unit 
initial level is drained to zero in a uniform finite time r and remains zero beyond 
T. Of course, conditions that guarantee stability depend on the service discipline 
of the network. In [7] Chen states necessary and sufficient conditions for stability 
of general work-conserving fluid networks. Stability conditions for fluid networks 
under FIFO and priority discipline have been derived by Chen and Zhang [TO] . 
|IIj . Often the strategy to prove such conditions is to use a Lyapunov function. 
In this context a locally Lipschitz function V : M.^ IR+ such that ^(a;) = if 
and only if a; = is called a Lyapunov function, if there exists a constant e > 
such that for each fluid model solution it holds that 

iV{Q{t)) < e 

whenever Q{t) ^ and the derivative at time t exists for the map s V{Q{s)). 
For more details see |14] . Within this framework linear Lyapunov functions of 
the form 

V{x) = h^x, X G R" 

where h is some positive vector in M.^ arc used to establish a sufficient condition 
for the stability of fluid network models under a priority discipline [TT]. The 
special case for this where h = (1, I)^ is used the show that a fluid model of a 
re-entrant line operating under last-buffer-first-served (LBFS) service discipline 
is stable, if the usual traffic condition pj < I is satisfied for all stations j [H] . 
This special case is also used to prove a stability condition for fluid networks 
under the join-the-shortest-queue discipline [15] . Ye and Chen investigated fluid 
networks under priority disciplines by using piecewise linear Lyapunov functions 
of the form 

V(x) = max h^,x 

l<j<N ■> 
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for some nonnegative vectors hi,...,hiy, for details see [H]- This approach yields 
a sharper stability condition for fluid networks under priority discipline than in 
Furthermore, in the verification of a stability condition for fluid networks 
under general work-conserving disciplines a quadratic Lyapunov function 

V{x) = Ax 

with a strictly copositive matrix A is used [7]. What all the works mentioned 
above have in common is that the existence of Lyapunov functions is only shown 
to be sufficient for stability. 

Before we investigate the question whether the existence of a Lyapunov 
function is also necessary for the stability of a fluid network, we recall briefly 
the basic idea of a Lyapunov function from the theory of dynamical systems. 
For a detailed description the reader is referred e.g. to p], [24]. Consider a 
dynamical system 

x = f{x), X e M", t e [0,oo) (1) 

with initial condition x(0) ~ xq and continuous /, where the origin is an equi- 
librium position, i.e. /(O) = 0. A real valued map V : Br C M" R is called 
a strict Lyapunov function for ([1]) if (i) it is positive definite and proper, i.e. 
there exist continuous and strictly increasing function a, h : [0, r) [0, oo) with 
a(0) = 6(0) = such that 

ai\\x\\)<Vix)<b{\\x\\), x&Br (2) 

and (ii) if there exists a continuous and strictly increasing function w : [0, r) — >■ 
[0, oo) with w(0) = such that for every solution x(-) and each interval / C 
[0, oo) one has 

T/(x(i2)) - Vixih)) < - r w{\\x{t)\\)dt (3) 

for each ti < t2 £ I provided that x(-) is defined on / and x{t) G Br for t £ I. 
It is well known that the origin is locally asymptotically stable, if and only if 
there is a strict Lyapunov function [3]. 

In order to obtain a so called converse Lyapunov theorem for fluid networks 
Ye and Chen followed a different, more general approach [34]. They collected the 
characteristic properties of fluid networks and defined a generic fiuid network 
(GFN) model as set 3> of functions Q : M.^ M.^ that satisfy a few natural 
properties. A precise description of a GFN model is given in Section [S] They 
proved that stability of a GFN model is equivalent to the property that for every 
function Q G $ a Lyapunov functional v : K+ M+ is decaying along Q. In 
particular, v can be chosen as 

/CJO 
\\Q{s)\\ds. (4) 

It can be seen that this approach differs from the one taken in the theory 
of dynamical systems in which Lyapunov functions are state-dependent. The 
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dependence on solutions is undesirable, because the benefit of Lyapunov's second 
method is that trajectories need not be known to be able to determine stability, 
whereas the method of Ye and Chen requires the knowledge of all solutions. In 
this paper we define a state-dependent Lyapunov function and prove a converse 
Lyapunov theorem. 

This paper is organized as follows. In the Section[5]we recall the definition of 
a GFN model from [34] . Further we discuss counterexamples to emphasize that 
the class of (closed) GFN models is too general to provide a converse Lyapunov 
theorem with state-dependent Lyapunov functions. In the Section [3] we intro- 
duce the class of strict GFN models by forcing the closed GFN models to satisfy 
additionally a concatenation and a lower semicontinuity property. The concate- 
nation property is essential for state-dependent Lyapunov functions whereas 
lower semicontinuity gives the additional benefit of continuity. For this model 
class we define a state-dependent Lyapunov function and prove that within this 
framework the stability of a strict GFN model is equivalently characterized by 
the existence of a state-dependent Lyapunov function. In Section 2] we recall 
some results from differential inclusions and viability theory that will be useful 
in Section [5l There we show that general work-conserving and priority fluid net- 
works define strict GFN models. In Section [S] we consider fluid limit models of 
queueing networks for a specific class of disciplines and in Section[7]we comment 
on linear Skorokhod problems. In Section[5]we explain why the approach of the 
current paper is not immediately applicable to FIFO systems. We conclude in 
Section 111 

We now collect some notations that will be used throughout the paper. By 
M.^ we denote the nonnegative orthant {x € M.^ : a; > 0}, where > has to 
be understood component- wise. Throughout the paper we mostly consider the 
space (R^, || • ||) with ||x|| := J2f=i Nd- Let £)(R+,R^) denote the space of 
right continuous functions / : M+ — > M.^ having left limits that is endowed 
with the Skorokhod topology [21]. Let C(IR+,M:^) be the subset of continuous 
functions. A sequence of functions, denoted by {fn{t))neN, in D(K-|-,K^) is 
said to converge uniformly on compact sets (u.o.c.) to a continuous function 
fit) € C(R+, ), if for any T > 

lim sup ||/„(t)-/(<)|| -0. 

"^oo te[0,T] 

We say that a function g : — > M is upper semicontinuous in a G M;^, if 
g(a) > limsup^_^Q 5(2;). Of course, g is called upper semicontinuous if it is 
upper semicontinuous for every a G M.^. Further a function 5 : R+ is 

lower semicontinuous at a G R:'i'^ if — g is upper semicontinuous in a G R:^ and g 
is called lower semicontinuous if g is lower semicontinuous in every point. We use 
to denote set-valued maps. Let X and Y denote metric spaces. A set-valued 
map F : X Y is a, mapping that maps every x £ X into a set F{x), called the 
value of at x. The domain of a set-valued map F : X Y is the subset of 
elements x G X such that the values F{x) are non empty, i.e. dom(F) = {x G 
X : F{x) ^ 0}. The image of F is the union of all values F{x) for all x E X. 
The graph of a set-valued map F is graph(F) := {{x, y) E X x Y : y £ F{x)}. 
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A set-valued map F is said to be closed- valued if the values of F are closed, i.e. 
for every x G X the set F{x) is closed. Accordingly, F is said to be convex if 
the images are convex. Moreover, a set-valued map F : X Y is called lower 
semicontinuous at x £ dom(i^) if for any y £ F{x) and for any sequence of 
elements (a;„)„gN S dom(F) converging to x, there exists a sequence {yn)nen 
with yn € F(x„) converging to y. F is said to be lower semicontinuous if it is 
lower semicontinuous at every point x S dom(_F). In addition, a set- valued map 
F is called upper semicontinuous at x £ dom(i^ ), if for any open neighborhood 
U D F{x) there is an e > such that for all x' € B{x,e) fl dom (F) it holds 
that F{x') C U . Again F is said to be upper semicontinuous if it is upper 
semicontinuous at every point x £ dom(F). 

Finally, by JC we denote the set of continuous functions w : M+ R+ that 
satisfy w{Q) = and are strictly increasing. 

2 Generic fluid network models 

In this section we consider generic fluid network models introduced by Ye and 
Chen in [34]. They present a trajectory-based Lyapunov method for character- 
izing the stability of fluid networks, in which the Lyapunov function depends 
on the path of the closed GFN model. First we recall from [31] the definition 
of a closed generic fluid network (closed GFN) model and the conditions for a 
function to be a Lyapunov function. Then we define a candidate for a Lyapunov 
function that does not depend on the path and show that in the setting it is 
not continuous in general. Further we give a counterexample that shows that 
within the class of closed GFN models the concatenation of two paths is not 
automatically contained in a closed GFN model, if the queue lengths at the time 
of concatenation coincide. 

Definition 2.1. |^]/ A nonempty set $ of junctions Q{-) : R+ — > M.^ is said 
to be a GFN model, if 

(a) there is a L > 0, such that for any Q{-) £ $ and t, s £ M+ it holds that 

\\Q{t)-Q{s)\\<L\t-s\. 

(b) Q{-) £ $ implies ^Q{r-) £ $ for all r > 0. 

(c) Q(-) £ $ implies Q{s + ■) e ^ for all s > 0. 

Furthermore, if the following condition is also satisfied, then we call $ a closed 
GFN model. 

(d) if a sequence {Qn)nGN C converges to u.o.c, then £ $. 

Any element (5(-) of $ is called a path (of $) and the set of paths with initial 
level one is denoted by $(1) = {Qi-) £ $ : ||(9(0)|| = 1}. Condition (a) states 
that the functions Q(-) are Lipschitz continuous, where condition (b) is a scaling 
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property and condition (c) is a shift property. We note that the terminology 
closed is not related to closed queueing networks where a fixed number of job 
circulate in the network. Rather, the content of condition (d) is that the set $ 
is closed in the topology of uniform convergence on compact sets. For future use 
we also introduce for x € M.^ the set $^ = {Q{-) G $ : Q{0) = x}. Moreover we 
recall from [5J the definition of stability of a GFN model. 

Definition 2.2. A GFN model $ is said to be stable, if there exists a t > 0, 
such that Q[t + •) = for any path Q{-) G *&(!). 

From a dynamical systems perspective the definition of stability for a closed 
GFN model $ seems to deviate from the asymptotic stability in the Lyapunov 
sense, where asymptotic stability is described by the following. The zero path 
is said to be asymptotically stable, provided that 

Lemma 2.3. $ is stable if and only if the zero path is asymptotically stable in 
the sense of Lyapunov. 

Proof. Suppose that $ is stable, i.e. there is a r < oo such that Q{t) = 
for all Q G $(1) and all t > r. Let Q(-) G $ and denote q := ||(9(0)||. The 
scaling property implies that ^Q{qt) G $(1) and consequently, Q{qt) = for all 
t > q^^T. This implies limt_>oo II<3(i)|| = and attractivity holds true. In [32] 
Theorem 6.1 it is shown that the stability of $ is equivalent to the condition 

inf ||Q(t)|| < 1 
t>o 

for ah Q(-) G $(1). This means that there is no Q{-) G $ such that |j(5(t)|| > 
||Q(0)|| for all t >0. Stability then follows by choosing e = 6. 
Conversely, let Q{-) = be asymptotically stable in the sense of Lyapunov. 
Due to the scaling property it suffices to consider a Q{-) G $(1). Then, by 
attractivity it holds that limt_j.oo 11(5(011 ~ 0- Proceeding exactly as in the 
proof of Theorem 6.1 in [32) shows the assertion. 

□ 

The notion of stability of a GFN may also be expressed by saying that the 
zero fluid level process Qo{-) = is the unique stable and attractive fixed point 
of the shift operator SrQ {•) ■= Qi- + t) defined on $. 

The Lyapunov method to characterize stability of closed GFN models pre- 
sented in [33] is as follows. A GFN model $ is said to satisfy the L-condition, if 
there exist class A^-functions Wi : IR+ M.^, i = 1, 2, 3 such that for any GFN 
path Q G there exists an absolutely continuous function v : IR+ — R-|_ such 
that 

M\\Qm)<vit)<w2i\\Qm), (5) 

m < -w,{\\Q{t)\\) (6) 
for almost all i > 0. The corresponding converse Lyapunov theorem is then 
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Theorem 2.4. A GFN model $ is stable if and only if the L-condition is 
satisfied. In particular, given Q G the function v can be chosen as 

/oo 
\\Q{s)\\ds. (7) 

We note that an equivalent way of interpreting v is as a functional u : <I> — >■ 
on the GFN model with the following properties. There are comparison 
function such that for each path Q{-) G $ its value under the functional v can 
be estimated from below and above by its initial value. That is, for any Q(-) S $ 
it holds that 

«^i(||Q(0)||) <S(g) <u;2(||Q(0)||). 

Furthermore, the evolution of v{Q) can also be estimated in terms of a compar- 
ison function. Precisely, the mapping t ^ v{Q){t + •) satisfies 

j^vmt+-)<-M\\Qm)- 

For this reason we refer to v, interpreted as w(0) =: v{Q), as a Lyapunov func- 
tional. As mentioned in the introduction the drawback of this definition is that 
the Lyapunov functional is path-dependent as opposed to be state-dependent, 
which is the basic idea of a Lyapunov function for a dynamical system. The 
definition of a Lyapunov function that only uses information of the state is as 
follows. We denote by A{<^) = {a; e : 3 Q(-) e g(0) = x}. 

Definition 2.5. Given a GFN model $ a function V : A(^) — i- is said to be 
a Lyapunov function, if there exist class JC functions Wi : M-|_ — > M_|-, i ~ 1, 2, 3 
such that 

wii\\x\\)<V{x)<W2{\\x\\), xeAi'S') (8) 
Vm))~V{Q{s))<^ [ w:i{\\Q{r)\\)dr (9) 

J s 

for all < s < t e M.+ and all paths Q{-) G $. 

For our purposes a certain candidate is useful; we consider in particular 
V : A{<^) ^ IR+ U {oo} defined by 

V{x)^ sup / \\Q{s)\\ds. (10) 

In the sequel we assume that A{^) = M.^. The function V defined in (|10p 
can be interpreted as a measurement of the state x in the sense that V{x) rep- 
resents the total possible fluid mass that the network has to deal with. An 
interesting question concerns the regularity of V. Of course, we aim for con- 
tinuous dependence on the state, as this would entail robustness of stability, 
see [33], [25]. Note that for stable closed GFN models the supremum in (fTO)) is 
actually attained because of the requirement of closcdness in Definition 12. II (d). 
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Proposition 2.6. // <I> is a stable closed GFN model, then the function V : 
A{^) — > M+ defined in (|10p is well defined and upper semicontinuous. 

Proof. It is an easy consequence of Lipschitz continuity, scaling property and 
stability that V{x) as defined in (fTO)) is finite. Let x S and (x„)„gN C 
be a sequence that converges to x. As $ is stable the set {V{xn) : n G N} is 
bounded. Hence there exists a subsequence )igN such that 

/•oo 

limsupy(x„) = lim ^(xnj = lim / ||(5„, (s)||ds 

ri-s-oo ;^-oo ;-i.oo Jg 

with (5,11(0) = Xni- Now, consider the family {Qn, (•) : Z G N}. Since $ is stable 
the family {Qni{-) : / G N} is bounded. By condition (a) in Definition 12.11 there 
is a single Lipschitz constant for any path Qmi') of the family {Qmi') : ^ G N} 
and thus the family is equicontinuous. By the theorem of Arzcla-Ascoli there 
exists a subsequence which converges u.o.c. to some Q*{-) with (5*(0) = x. 
Since the model is closed it follows that (5*(-) G $. Hence by the definition of 
V it holds that 

limsupV^(x„) = lim / ||Q„,(s)||ds= / ||Q,(s)||ds < ^(.t). 

This shows the assertion. □ 

As we are interested in the continuity of V the question remains whether V 
is also lower semicontinuous. 

Example 2.7. Let K = 2 and 



It is easy to check that $ is a stable closed GFN model. We consider xq = (1 1)"^ 
and Xr, = (1 + — 1 — — It holds that 

1 1 

lim V{xn) = lim / (1 + - - i)+ + (1 t)+dt 

rn-oo rn-oo Jg n n 

= hm lf(l + i)2 + (l-M=l 



2 



1 



<2 = / 2il--t)dt = Vixo). 
Jo ^ 

So V defined by ilO\) is not necessarily lower semicontinuous for stable closed 
GFN models. 

Remark 2.8. The example shows that in the frame of Definition \2.i\ our candi- 
date V is not continuous in general. The problem with this example is that along 
the diagonal a particular solution exists which is not approximated by solutions 
starting close to but not on the diagonal. 
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The key property of a Lyapunov function V for a dynamical system is, that 
V is decreasing along trajectories. The trajectories in the context of closed 
GFN models are the paths. The next example addresses this problem. Here the 
concatenation of paths plays a key role. For this reason wc provide a definition. 

Definition 2.9. Let ^ be a closed GFN model and suppose that Qi{-),Q2{') 
are paths of $ such that for some t* > it holds that Qi{t*) = Q2{0)- Then 
Qi Of Q2 defined by 



QiOf Q-iit) := 
is called the concatenation of ( 



I Qi{t) for 0<t< t* 

[Q2(t-t*) for t>t* 

hi-) andQ2{-) att*. 

In the previous definition note that if Qi{t*) 
s > 0, then because of the shift property we can consider the concatenation 
of Qi(-), Q2(s + •)• III this sense evaluation of Q2 at in the definition poses no 
restriction. 



Q2{s) for an arbitrary 



Example 2.10. Let K 



2 and define for given xi,X2 G M+ the paths 
if 0<t<xi, 

if t > xi. 




and 

" ''xi + A 

,X2 t) ^ 

Xi +X2 -t\ 

Then consider the stable closed GFN model 



Q2{t) = <^ 



if t < X2, 
if t>X2- 



$ = {Qi(-),Q2(-) : Xi,X2 gM+}. 

In this GFN model it is obvious that paths cannot be concatenated. However, 
let us assume that V is a state- dependent Lyapunov function which is decaying 
along paths. The closed GFN model $ has the following property. For every 
state z ~ {zi,Z2) there is a state y — (2/1,1/2) such that there two paths that 
go to zero, where one path starts in z and passes through y and the other path 
starts in y and passes through z. As V is decaying along paths it follows that 

Viz) < Viy) 

which is a contradiction. 



and V{y) < Viz), 



Example 12.101 shows that in the framework of Definition 12.11 there are GFNs 
that are stable and for which no Lyapunov function in the sense of Definition l2.5l 
can be defined. It will thus be the aim of the following section to identify 
situations where this is possible. 
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3 A Converse Lyapunov Theorem 



In this section we present a way out of the dilemma. We restrict the class of 
closed GFN models by adding two conditions, namely a concatenation property 
and a lower semicontinuity property. Fluid models with these properties are 
called strict GFN model. The main result of this section is that the Lyapunov 
function candidate (jlOp is appropriate to prove a converse Lyapunov theorem for 
the class of strict GFN models. The road map is as follows. First we present the 
two additional conditions for the closed GFN model. After that we show that 
under this conditions the candidate (|10|) is continuous. In the sequel we prove 
the main theorem. Similar to the closed GFN model we introduce the following 
notations Q(l) = {Q(-) e Q : ||Q(0)|| = 1} and = {Q(-) £ Q : Q(0) = x} for 
X e M^. 

Definition 3.1. A set Q of functions Q{-) : is a strict GFN model, 

(a') it is a closed GFN model 

(e) for GFN paths Qi{-),Q2{-) G Q with Qi{t*) = for some t* G R+, 
the concatenation Qi 0(. Q2i-) is also a path of Q. 

(f) there is a T > such that the set-valued map x Qx|[qji] is lower 
semicontinuous. 

It is possible that a closed GFN model satisfies (e) and not (f). We do not 
introduce yet another name for such GFN models but simply speak of a closed 
GFN model satisfying (e). 

Remark 3.2. We note for further reference, that for GFN models satisfying 
(e) the semicontinuity condition (f) can be stated equivalently as 

(f) for each Xq so that Q^g ^ there exists a T(xo) > such that the set- 
valued map X ^ Qj:\^i^ t{xo)] semicontinuous at xq- 

It is clear that (f) implies (f). Conversely, note first that the uniform Lipschitz 
constant guaranteed by Definition \2.1\ (a) implies that if a sequence of paths 
(Qra)neN converges u.o.c. on an interval [0,Ti),Ti < oo, then the sequence 
converges uniformly on the closed interval [0,Ti]. Now fix any T > Q, xq and 
a To := T(.To) such that (f) holds. Ghoose Q{-) G Qxo o,iT-d- a sequence (x„)„gN 
converging to xq. We have to construct a sequence Qn{') G Qx„ such that 
Qni') — ^ Qi') uniformly on [0,r]. We may assume that Tq < T as otherwise 
there is nothing to show. By assumption there exist G Qx„ such that 

Q\{-) — > Q(-) uniformly on [0,ro]. In particular, QI^{Tq) — ^ Q{Tq). By the shift 
property Q{Tq + •) G Qq(To) '^"■'^ so for Ti := T(Q(Tq)) we may by (f) choose 
a sequence Q^i-) G Qqj^(To) such that Q^(-) — > Q{Tq + •) uniformly on [0,Ti]. 

Now define the concatenation := QnOToQni') o.'i^d note that Q^i') — > Q{-) 
uniformly on [0, Tq + Ti] . Repeating this step countahly often, we can construct 
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an open interval [0, T) such that there exist Qn{-) € Qx„ such that Qn{') — >■ Q(-) 
u.o.c. on [0,T). Assume that T < oo is chosen as the maximal real for which 
this u.o.c. convergence is possible. 

Then by our first remark Qni') Q(') uniformly on [0,T]. Then we can 
repeat the argument and extend the uniform convergence to the interval [0, T + 
T(Q(T))]. This contradicts the assumption that T was chosen to be maximal. 
This shows the equivalence, as T can be arbitrarily large and so chosen to be 
bigger than T . 

We have seen that the absence to certain concatenations is an impediment 
to the existence of Lyapunov function in Example 12.101 Next we show that 
conditions (e) and (f) close the gap from upper semicontinuity to continuity. 

Proposition 3.3. If Q is a stable strict GFN model, then V defined in (|10p is 
continuous. 

Proof. We show that V is lower semicontinuous as the continuity of V then 
follows together with Proposition 12.61 Let x^ S R;^ and Q*{-) S Qx, be such 
that 

/•oo 

V{x.) = / WQMWds. 
Jo 

Further let (a;„)nGN be a sequence that converges to x*. By condition (f) in 

Definition 13.11 there exists a T > and a sequence ( Qn(-)\ m ) in Qx I m -t^i 

V '["•-'l/neN "40:-' J 

that converges uniformly to (5*(-)|[or]' particular, x\ := Q„(T)|jpyj con- 
verges to a;^ := (T) ^^^^ as n ^ oo. Moreover, for Qi (■) | [q t] ^ I [o t] 
that Qi(-)|[oT] ^ ^*^'^\[T 2T\ condition (f) yields the existence of a sequence 
I [o,T] satisfying 

iii^^»^')|[o,T] =^*(')|[o,T] uniformly. 

Using the concatenation property (e) we have a sequence (Qn(')l[o,2T])neN G 
Sa:„|[o,2r] that converges u.o.c. to Q*(-)I[o,2T] G Qx.\[{),2T\- A successive con- 
tinuation in this manner yields the existence of a sequence Qui') G Qx^ that 
converges u.o.c. to G Qx,- As Q is stable and using the same arguments 

as in the proof of Proposition 12.61 we have 

/•Ctt /"OO 

V{x,)^ / \\Q4s)\\ds= lim / |lQ„(s)|lds < liminfy(x„). 

Jo "->°ojo 

That is, V is lower semicontinuous. □ 

Now we state the main theorem. 

Theorem 3.4. A strict GFN model Q is stable if and only if it admits a Lya- 
punov function. In particular, V can be chosen as 

poo 

V{x)= sup / \\Q{s)\\ds 
Q(-)6Sx Jo 
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and V is continuous. 

Proof. First wc show that the existence of a Lyapunov function is sufficient 
for stabihty. Let V he a. Lyapunov function for Q. From ([8]) it follows that 
^{Q{t)) > and inequality (O implies that 

V[Q{t2))-V[Q{h))<Q 

for all ii < t2 G - So V{Q{-)) is monotone decreasing and bounded. In order 
to show that V{Q{t)) tends to zero as t goes to infinity assume that 

lim V{Q{t)) =: c> 0. 
Then for alH > it holds that 

Q<c<v{Q{t))<w2mm) (11) 

and further < 1x^2^^ (c) < j|(5(t)||. It also holds that 

0<w:i{w^\c))<w^{\\Q{t)\\). 
Now observe that from ^ it follows that 

V{Q{t))~V{Q{0))<- f W3{\\Q{s)\\)ds< - f W3{w^\c))ds<-W3{w^\c))t 
Jo Jo 

and hence limt^ooV {Q{t)) ~ —00, which is a contradiction to ([TT|) . Conse- 
quently 

lim V{Q{t)) = 0. (12) 

t—>oo 

By ^ it follows that 

hm ||Q(t)|HO. 

So the zero path is asymptotically stable and this implies by Lemma 12.31 the 
stability of the strict GFN model Q. 

Conversely suppose that Q is stable. Then there is a r > such that 
Q{t + ■) = for all paths Q{-) G Q(l). Wc define the following comparison 
functions 

wi(r) := — , W2{r) -.^ r'^ {1 + Lt)t, W3{r) -.^ r 
and show that our candidate 

/•oo 

V{x)= sup / \\Q{s)\\ds 
Q()eQ. Jo 
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is a Lyapunov function. As Q satisfies the Lipschitz condition (a) it follows that 

\\Q{s)\\>\m)\\ ^L{s-t) (13) 
for all Q G Q and s > t. In particular for t = this implies 

||Q(s)|| > ||g(0)|| -Ls. (14) 
Using the last inequality wc got the following estimate from below 



Vix)= sup / ||g(s)||ds> sup / \\Q{s)\\ds 
Q(-)6Sx"'o Q(-)eQxJo 



> sup / (||a;|| — Ls) ds 



To obtain an estimate from above consider Q(-) e Q^.. Note that by the scaling 
property it follows that Q(\\x\\-) G Q(l) and further the stability of Q implies 
that 

Q(s) = Vs>||x||t. (15) 

The triangle inequality together with the Lipschitz condition imply that for all 
s e [0, llxllr] it holds that 

||g(s)|| < ||Q(0)|| +L||x||r=||:r||(l + Lr). (16) 

With (|15p and ([T5| an estimate from above is derived as follows 

V{x)= sup / \\Q{s)\\ds< sup / \\x\\{l + LT)ds 

= 11x^(1 + Lr)r = w,i\\x\\). 

Now consider the decrease condition 



V{Qit2))~V{Q{h))^ sup / ||Q(.s)||ds- sup / \\Q{s)\\ds. 

Q(-)eSQ(t2) Jo Q(-)eQQ(ti) "'0 



From condition (e) it follows that 

/•OO 

V{Q{h))= sup / \\Q{s)\\ds 



Q(-)6SQ(ti) "'0 
rt2 poo 

> / \\Q{s)\\ds+ sup / \\Q{s)\\ds 

Jti Q(-)6QQ(t2) "'0 

\\Qis)\\ds + ViQit2)). 

ti 
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and hence 

ViQih))~ViQ{h))<- \\Q{s)\\ds^- f\3i\\Qis)\\)ds. 

Jtl Jtl 

Thus together with Proposition 13 . 31 we see that ^ is a Lyapunov function. 

□ 

From the proof of the previous theorem we see that the semicontinuity prop- 
erty (f) is only needed to conclude continuity of V. Thus we have also proved 

Corollary 3.5. A closed GFN model $ that satisfies the concatenation property 

(e) is stable if and only if it admits a Lyapunov function. In particular V can 
he chosen as in (jlOp and V is upper semicontinuous. 

Remark 3.6. Since upper semicontinuous Lyapunov function do not imply ro- 
bustness statements the benefit of Lyapunov functions that are upper semicon- 
tinuous is restricted compared to continuous Lyapunov functions, see JES}/ . \3S\/ . 

4 Fluid networks as differential inclusions 

Wc want to apply the main theorem to fluid network models that work under 
a specific discipline. So we need to show that the additional conditions (c) and 

(f) arc satisfied in each case. In order to obtain condition (e) we make use of 
concepts from the theory of differential inclusions. Clearly a detailed description 
of the dynamics of a fluid network depends on the specific discipline that is used. 
But one part of the dynamics of fiuid network models that all service disciplines 
have in common is the so called fiow balance relation 

Q{t) = Q{0) + at-{I-P^)MT{t). (17) 

Here a G M.^ represents the infiow rate, /i £ M.^ denotes the outfiow rate, 
M ~ diag(/i) and P is the routing matrix. The initial value or level of the 
fluid network is given by Q{0) — x. A basic property of the fluid level process 
Q as well as the allocation process T{t) is that both processes arc Lipschitz 
continuous [7] and hence differentiable almost everywhere. So for almost all 
t G R+ the fiow balance relation (|17p can also be written as 

Qit) = a-{I-P^)Alt{t), Q{0)^x. (18) 

Now we consider the derivative of the allocation process as the control variable, 
i.e. we define u{t) := T{t) a.e. . Note that u is measurable. The allocation 
process is determined through the service discipline. So each service discipline 
has a set of admissible controls U{Q), where u £ U{Q) if and only if w G 
M.^ satisfies some allocation conditions that are specific to the discipline. As 
mentioned in [7] the allocation process need not be unique and so for every 
g G there are different choices of u possible. But the admissible control 
values u depend on the fiuid level process Q(t) through the allocation conditions. 



14 



Consequently we consider the set of admissible control values as a set U{Q). 
Thus, the flow balance relation ([18]) can also be expressed by a difi'erential 
inclusion of the form 

Qit) ^a-il-P^) Mu{t) f{Q{t),u{t)), g(0) = Qo 

with u{t) G U{Q{t)). Often U is referred to as the feedback map. By setting 

F{Q)^{f{Q,u) : u^U{Q)} (19) 

we rewrite this as a closed loop differential inclusion 

Q{t) e F{Q{t)), g(o) = Qo. (20) 

In the following we state some results from the theory of differential inclu- 
sions that will be useful to show that specific fluid networks satisfy the conditions 
(e) and (f). Let K C M" and consider the differential inclusion 

x{t) e F{x{t)). (21) 

Let Sf{xq) denote the set of solutions to (|2T|) starting at xq & K. The existence 
theorem is as follows [211 Theorem 5.2]. 

Theorem 4.1. Let K C M" he a closed set. Assume that the set-valued map 
F : K M" with closed convex values contained in a ball of radius b > is 
upper semicontinuous. Then the following conditions are equivalent. 

(1) For any xq G K there is a solution x{-) £ Sf{xo) satisfying x{t) £ K for 
all t > 0. 

(2) For any x £ K it holds that F{x) n Tk{x) ^ 0. 

Here Tk{x) denotes the contingent cone to K C K" at x, which is defined as 
the set of v G M" such that there is a sequence (/in)neN C int(R+) converging 
to and a sequence {vn)n&n C M" converging to v such that for all n G N it 
holds that x + hnVn £ K. A useful criterion to conclude upper semicontinuity 
of a parameterized set-valued map is the following [21 Proposition 1.4.14]. 

Proposition 4.2. Let X, Y and Z be metric spaces and U : X Z be a 
set-valued map. Assume that f : graph(U) Y is continuous. If U is upper 
semicontinuous with compact values then F : X Y defined by 

F{x) :={/(x,w) : u G C/(x)}. 

is upper semicontinuous. 
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5 Applications to some fluid networks 



In this section we show that our main result can be apphed to some special 
fluid networks. In particular, we show that fluid networks under general work- 
conserving and priority disciplines satisfy the additional conditions (e) and (f) 
given in Definition [3TTJ The following description of a fluid network is taken from 
[33]. A fluid network consists of K different fluid classes and J stations, where 
the fluids are served. There is a (not necessarily injective) map s that prescribes 
which fluid class is served at which station. Fluid class k is exclusively served at 
station s{k). For every station the set C(j) := {k £ {1, : s{k) = j} can 

without loss of generality assumed to be nonempty. The corresponding J x K 
matrix C is called the constituency matrix, where Cjk = 1 if s{k) ~ j and zero 
else. Further wc introduce two nonncgative vectors a, fi ^ M.^ and a. K x K sub- 
stochastic matrix P. Where ak denotes the exogenous inflow rate of fluid class k 
and fik denotes the potential outflow rate of fluid class k. The matrix P will be 
referred to as the routing matrix. The element pki of P denotes the proportion 
of the outflow of class k which turns into fluid class I. So 1 — ^^-^ pki is the part 
of the outflow of class k that leaves the network. The routing matrix is assumed 
to have spectral radius strictly less than one, i.e. all fluids eventually leave 
the network. The initial fluid level is represented through the A'-dimensional 
vector Qq. The fluid network is described by (a, /i, P, C) with initial fluid level 
Qo- The time-evolution is described by the ii'-dimensional fluid level process 
{Q{t) t > 0} and the /C-dimensional allocation process {T{t) : t > 0}, where 
Qk(t) denotes the amount of class k fluids in the network at time t and Tk{t) 
denotes the total amount of time during the interval [0,t\ that station s{k) has 
devoted to serve fluid class k. We note that the processes are Lipschitz contin- 
uous and hence differentiable almost everywhere by Rademacher's Theorem. A 
precise description of the dynamics of a fluid network depends on the service 
discipline. 

5.1 Fluid networks under general work-conserving disci- 



The dynamics of a fluid network under a general work-conserving service disci- 
pline can be summarized as follows 



where M = diag(/i). Equation (|25|) describes the work-conserving property of 
the network and relation is called the flow balance relation. In general the 
allocation process is not unique. Any pair ((5(-),T(-)) that satisfies is 



plines 



Q{t) 
r(o) 

m 



Qo + at- {I - P'^)MT{t) > 0, 

and T(-) is nondecreasing, 

et — CT{t) and /(■) is nondecreasing, 



(22) 
(23) 
(24) 




(25) 
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called fluid solution of the work-conserving fluid network. The set of all feasible 
fluid level processes is denoted as 

Qc = {(?(■) : 3r(-) such that (Q(-),r(-)) is a fluid solution}. 

To prove the existence of a work-conserving allocation process we bring the 
conditions ([231)- (HSI into the context of differential inclusions. To this end, we 
define T{t) —: u(t) and consider the differential form of the flow balance equation 

Q{t) =a- {I - P^)Mu{t). (26) 
For Q G 1$.^^ the conditions defining the admissible values of u are 

M > 0, e - Cu > 0, {CQf • (e - Cu) = . (27) 

These are immediate consequences of (P^ . and in their differentiation. 
Note the discontinuity of these conditions on the boundary of K;^ , because in 
this case zeros may appear in (CQ)^ . Now the set of admissible controls is 

UciQ) := {u G M^' : Jill) is satisfied } . 

Using f{Q,u) := a — (/ — P^)Mu this leads to a differential inclusion of the 
form 

Q{t)e{f{Q{t),u) : u€Uc{Q{t))]. (28) 

For brevity, we define the following set-valued map F : M.^ by 

F{Q)^{f{Q,u) : u^UciQ)} (29) 

so that the corresponding differential inclusion compactly reads as 

Q{t) G F{Q{t)), g(0) = Qo- (30) 

Using this approach we are able to give an alternative proof for the Theorem 
2.1 in [7]. 

Theorem 5.1. For any work-conserving fluid network {a, fi, P,C) with an ini- 
tial level Qo the set Qc is nonempty. 

Proof. From the conditions ((27)) it follows that the set Uc{Q) is compact and 
convex and upper semicontinuous. Further, the set- valued map Uc{-) is upper 
semicontinuous and f{Q,u) is continuous. Hence, by Proposition 14.21 the set- 
valued map F is upper semicontinuous. Moreover, F has closed convex values 
that are contained in some ball with radius 6 > 0. Also the conditions (P7| imply 
that F{Q) n 7Jj-k(Q) ^ for all Q G K+. Then by Theorem O there exists a 
solution to pO|. To show the existence of an allocation T let Q{-) be a solution 
to ((30)) . Note that f{Q,u) is continuous in u and the that U{t) {u G : 
e — Cu > 0, (C Q{t))^ (e — Cu) = 0} is closed and bounded. Also, we note that 
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t ~-> U{t) is upper semicontinuous. Then, by the Fihppov measurable selection 
Lemma in [22j p. 78/79], there is a measurable selection u{-) of u{t) G Uc{Q{t)) 
such that 

Q{t) :^a-{I - P'^)M u{t) for almost ah t > 0. 

Thus, integrating the latter yields that, given the initial value Qq, the pair 
(Q(-),T(-)) with T{t) := Jou{s)ds is a fluid solution. 

□ 

So, we can represent the set of work-conserving fluid level processes by 

Qc = {Q(-) e Sf{Qo) : Qo e }• 

In [33] it is shown that Qc defines a closed GFN model. So we only have to 
prove that the conditions (e) and (f) are satisfied. 

Proposition 5.2. The set of fluid level processes Qc satisfies the concatenation 
property. 

Proof. Since solutions of differential inclusions are by definition absolutely con- 
tinuous functions, and concatenation preserves absolute continuity the assertion 
follows. 

□ 

To show that condition (f ) is satisfied we need to show that the solution map 
is lower semicontinuous. 

Theorem 5.3. The set of fluid level processes Qc satisfies the lower semicon- 
tinuity property (f). 

Proof. To show condition (f) we have to verify the existence of a T > such 
that Qo '5_f(Qo)|[o,t] is lower semicontinuous. In view of Remark 13.21 and 
Proposition 15.21 it is sufficient to construct for each Qo a T{Qo) > such that 
(f) holds. 

To this end, let Qq e be fixed, Q(-) e SpiQa)- Then, by the proof of 
Theorem 15. II there exists a fimction u(-) G U{Q{-)) such that 

Q{t) = Qo + at- {I - P'^)M [ u{s)ds. (31) 

Jo 

We distinguish the following situations. 

First, suppose that Qq € M.^ and all stations have some nonempty queues, 
i.e. CQo > 0. Hence, there is a T{Qo) > such that CQ{t) > for all 
t £ [0,T{Qo)]. We note that (CQ)^ • (e - Cu) from ^ also reads as 

j=i \iec(j) \ lecij) / / 
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Since both factors are nonnegative and, in fact, CQ{t) > for t G [0,T{Qo)], it 
holds that 

1= "'(■)l[o,T(Qo)] =: eJCu(-)|[o,T(Qo)] (32) 

for all J = 1, J. Let (Qg )riGN be a sequence of initial values which converges to 

Qo and define 6 := minfe^i k Qq^- Furthermore, \ct < S' < S and N{S') £ N 

be such that for all n > N{5') we have that \\Qq — Qo\\ < 5'. In particular, it 
holds that G int(M^) for aU n > N{S'). Hence, there is T > such that 
<3(-)l[o,T] e int(M^) and (5"(-)|[o,t] e int(M^) for aU n > N{S'). Now consider 
the paths 

Q'^it) ■=Q'^ + at- {I - P^)M f u"(s)ds, 

Jo 

where for n > N{S') we define u"(s) := u{s). For n sufficiently large we have 
that Q"(t) G int(Mf ) for t G [0,T{Qo)], because 

lim sup ||Q"(t) -g(t)|| =0. (33) 

"^°°tG[0,T(Qo)] 

Consequently, Q ^ '5F(Q)|[o,T(go)] lower semicontinuous at Qo- 

Second, suppose that the initial fluid level at some stations is zero. We first 
treat the case of a single station with empty queues. Without loss of generality 
let this station he j = 1 and let a denote the set of classes which are served 
at station 1. Then, the last constraint in (P7)) is not active for station 1 and 
therefore the constraints for fluid classes fc G a are given by 

Uk>0, 1 - 51 ^ 0- (34) 

However, since Q(-) is a solution to the differential inclusion pO)) potentially 
only a proper subset of (|34p is feasible. If this condition enforces equality in 
the second constraint in then we can argue as in (jSH) on a sufficiently 

small time interval and the proof of applies again. The interesting case 
is when there is idle capacity at station j = 1. Here Uk{-) > are such that 
Siea '"'(■) ^ ^'^'-^ that the fluid levels of classes k G a remain nonnegative. 
Using b := {1, K}\a the differential form of the flow balance equation (|22p 
can be expressed in block form by 



Qa{t) 




Ota 










'Ma ■ 




Ua{t) 




'Ma " 




Ua{t) 






at 


+ 




PI. 




Mb 




Ub{t) 




Mb 




Ub{t)_ 



The nonnegativity of the fluid levels for classes / G a yields the following condi- 
tion 

< aa + Mb Ub{-) - {la - Pi) Ma Ua{-), 
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which also reads as 

Ua{-) < {la - PT)-' K + Pib Mb Ub{-)). 

As eJCQo > for j ^ 1 then, arguing as in there is a T{Qo) > such that 
the alfocation rates corresponding to fluid classes present at the stations j ^ 1 
satisfy EiecQ) "'(")I[o,t(Oo)] = 1- Let £ > be fixed, so that if \\Qo - Q\\ < s 
then Qk > when Qo^k > 0. Now, for another initial value with HQo — Qoll < 
e we consider it^(-) := (ua(-) +«(•) "6(0)"^: where «(•) takes values in RI^I such 
that 



(35) 



lea 



and = otherwise. Then, we consider the solution Q^(-) associated with 
tt^(-) and Ql, i.e. 



Wa(s) + v{s) 



Q1-Q0 + Q{t) -{I- P^)M 



Ub{ 


^) 


f 


v{s) 


Jo 






ds 
ds. 



So, the difference between the solutions Q{-) and Q^{-) is given by 



/' 






'MaV{s) 


Jo 


PlMavis) 








In particular, as Qo.a — we have that 

Qlit) - Qait) = -{I- Pj)Ma f V{S) ds. 

Jo 

Hence, if Qq „ > the nonnegativity of (/ — Pj)Ma and v{-) imply that there 
is a r > such that 



Ql,a-{I-Pl)Ma f v{s)ds = Q. 

Jo 



(36) 



We will assume that v{-) is chosen so that the time in which (|36p is achieved is 
minimal. 

Thus, given a sequence of initial values ((5o)n6N converging to Qo and in 
particular Q^^ converging to zero, we define 



r„ := min{r > : «"(•) satisfies ([55 ]) and ([55 ]) } 



and 



{Ua(t)+V^{t) Ub(t)Y 
{Ua{t) Ub{t)Y 



for < t < 
for t > r„ - 
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Further, we note that ([5^ imphes that if Qq^ converges to Qo,a = it holds that 
r„ converges to zero as welL Hence, we have that «"(•) converges to u(-) and 
consequently Q"(-) converges uniformly to Q{-) on [0,T{Qo)], i.e. Q(-)I[o,t(Qo)] 
depends lower semicontinuously on Qo- 

The cases where more than one stations have empty queues follows the same 
line of reasoning. Finally, the assertion follows from Remark 13.21 

□ 

Summarizing wc obtain. 

Theorem 5.4. General work-conserving fluid networks define strict GFN mod- 
els. In particular, it is stable if and only if it admits a continuous Lyapunov 
function. 

5.2 Fluid networks under priority disciplines 

The priority service discipline assigns different priorities to the fluid classes 
that are served at one station, [34]. This is done via a permutation mapping 
TT : {1,...,A'} {l,...,if}. To be precise, let s{l) = s{k) for l,k £ {!,..., K} 
then fluids of class / have higher priority than fluids of class fc, if tt{1) < 7r(fc). 
That is, fluids of class k arc not served as long as the fluid level of class I is 
greater than zero. For each k G {1, K} the set of fluid classes that are served 
at the same location s{k) and have higher priority is denoted by 11^ {I G 
{1, ...,K} : I G C(s(fc)), tt{1) < 7r(A;)}. To derive a description of fluid networks 
under the priority discipline tt we introduce the unused capacity process Y{t). 
Namely, Yk(t) is denotes the cumulative remaining capacity of location s(fc) for 
serving fluids of classes that have strictly lower priority than fluids of class k. 
The dynamics can be described as follows 

Q{t) = Qn + at-{I-P^)MT{t)>0, (37) 
r(0) = and r(-) is nondecreasing, (38) 

Ykit) = t-Y^ Ti{t) and Y{-) is nondecreasing, k G {1, A'} (39) 

nOO 

0= / Qk{t) dYkit), ke{l,...,K}. (40) 
Jo 

Any pair {Q{-),T{-)) that satisfies ([57)) - (pn)) is called a fluid solution of the 
fluid network under the priority discipline tt. The set of all feasible fluid level 
processes is denoted as 

Qp = {Q{-) ■■ 3T(-) such that {Q{-),T{-)) is a fluid solution}. 

Again we bring this into the context of differential inclusions by setting T(t) = 
u{t). The constraints for k G {1, A'} are here 

Uk>0, 1 - ^ > 0, Qfc ■ (1 - ^ u;) = (41) 
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and the set of admissible controls is 

UpiQ) {u G M+ : (gH) is satisfied for all k e {1, ...,K}} . 
Following the same line of reasoning we conclude the following. 

Theorem 5.5. The set Qp is nonempty and satisfies the lower semicontinuity 
property. 

In order to prove that Qp is a strict GFN model it remains to show that 
the concatenation property holds, as the validity of the conditions (a)-(d) is 
shown in |341 Lemma 3.5]. Using results from differential inclusions we obtain 
the following result. 

Proposition 5.6. The set Qp satisfies the concatenation property. 

Thus we may conclude. 

Theorem 5.7. The fluid network under priority discipline Qp is a strict GFN 
model. It is stable if and only if it admits a continuous Lyapunov function. 

6 Fluid limit models of queueing networks 

A further class of interest are fluid limit models of queueing networks. For 
this class the open question remained whether they define closed GFN models 
[M] . As we will see, taking the closure with respect to uniform convergence on 
compact sets does not change the stability properties. In this way we obtain 
from fluid limit models closed GFN models. We state a condition for which 
we conjecture that it guarantees condition (e) but so far a proof has remained 
elusive. 

A queueing network consists of J stations that serve K classes of customers. 
For each class k € {1, if} the interarrival times are denoted by {^fe(n) : n > 
1} and the service times are given by {r?fe(n) : n > 1}, where n £ N denotes the 
place in the sequence of customers of the considered class. It is possible that for 
some customer classes k no exogenous arrivals take place, then the interarrival 
time Cfc(n) = oo for all n. The set of customers with exogenous arrivals is 
denoted by 

£ {k e {1, K} : ^(n) < oo, n > 1}. 

Further the waiting buffer at each station is assumed to have infinite capacity. 
The random variables above are defined on some probability space P). 
The following assumptions on the interarrival times and service times rjk are 
made. 

^1, ^/^, 771, 77/^ are i.i.d. and mutually independent. (Al) 
The first moments are assumed to be finite, i.e. 
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a-'=E[^k{l)]<^ yke{l,...,K}, 
/i^'=E[77fe(l)] <oo ykes. 

The interarrival times are assumed to be unbounded and spread out, i.e. for 
each k € £ there exists some integer jk € N and some function pk : R+ — )■ R+ 
with pk{x)dx > 0, such that P[^k{^) > x] > Q for all x- > and 



r 



a<^^k{i) <b > / pk{x)dx VO < a < 6. (A3) 



Let (j)'^{n) be the routing vector for the nth customer of class k who finishes 
service at the station s{k). So (f)*'{n) is a /C-dimensional Bernoulli random 
variable with parameter P^. The corresponding routing matrix P is assumed 
to have spectral radius strictly less that one. Further, it is assumed that for 
each k G {1, the routing process 

/ = {0*^(71) : n > 1} 

is i.i.d., (j)^ , (j)^ arc independent and independent of the arrival processes 
and service processes. The evolution of the queueing network is described by 
a Markov process X = {X{t),t > 0} on a measurable state space {X,Bx) 
that is defined on a measurable space {il,J-'). Further, X is adapted to the 
filtration (J^t)teR^ and the probability measures {Vx,x G X} on {ft,J-) satisfy 
Vx[X{Q) = a;] = 1 for all x € X. In general the states are given by points 

where \£\ denotes the cardinality of £ and denotes the set of finitely ter- 
minating sequences in T^k = {1, 2, A'}. For instance, for priority queueing 
networks the state space is a subset of Z;^ x M;^^''^'. For further details see 
[6l [12] . Analogous to the fluid models there is a set of equations that embraces 
most of the network dynamics. Consequently, Q^{t) S D(R_|_,M^) denotes the 
queue length process and T^{t) G D(R+,R:^) denotes the allocation process. 
The superscript x expresses the initial state x = (g, u, v), where vectors q, u and 
V denote the queue length, the residual interarrival time, and the residual ser- 
vice time. Consider a pair of sequence (rn,Xn)n&i, where a;„ G A" is a sequence 
of initial states and r„ G IR.+ such that 

r ,■ hn\\ ^ y \\U„\\ \\Vn\\ 

hm r„ = oo , limsup < oo , lim — lim ~ 0. (42) 

n-J-oo n->oo Tn ri^oo r„ n^oo r„ 

In [nmi] it is shown that under the assumptions (|Aip - (jA3p for almost all sample 
paths w G 51 and any pair of sequence (r'„,a;„)„gN satisfying ([^^ there is a 
subsequence such that almost surely 

— (Q""^ (r„^t),T"":'- {rn^t)) (Q{t),T{t)) u.o.c. as j ^ k), (43) 
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where Q(-),T(-) G C(IR+,R:5^). For a fixed queueing discipline any limit Q{-) is 
called a fluid limit path of the discipline with initial level (5(0), if {Q{t), T{t)) 
arc limits in the sense above. The set of all such fluid limits Q is denoted by 
Ql- We define the fluid limit model as the closure with respect to uniform 
convergence on compact intervals of Ql and denote it by Q^. 

Lemma 6.1. The fluid limit model Ql is stable if and only if Ql is stable. 

Proof. Obviously, if Ql is stable then Ql is stable. Conversely, assume that 
Ql is stable. Let G Ql\Ql and Qn{-) S Ql be a sequence such that 

Qn{-) Q*{') u.o.c. as n — cx). Since Ql is stable there is a uniform t > 
such that Qn{T + •) = for all n G N. It follows for all t > r that 

Q4t) = lim Q„(t) =0 

n— f C30 

and the proof is completed. 

□ 

Proposition 6.2. The fluid limit model Ql defines a closed GFN model. 

Proof. The Lipschitz continuity and the scaling property are shown in |34] . To 
show the shift property we follow an idea that is due to [251 Section 9.2.3]. Let 
J^C{q) denote the set of fluid limits with initial level q, i.e. 

TC{q):={Q:m+^ K^' : Q{t, q) = lim — Q"" (r„ t) , Q(0) = q } 

We fix a pair of sequences (r„,a;„)„gN that satisfies and lim„_>.oo = 
(g, 0, 0). Then, by the Skorokhod's Theorem [551 Theorem C.6] we have along 
a subsequence 

lim — Q^^"^ (r„, t) = Q"'' (t, g) G 
fc->oo r„^ 

a.s. in the Skorokhod topology. The superscript to the fluid limit expresses the 
dependence on the particular sequence. Moreover, by the Markov property we 
have the following equality in distribution 

Q--(r„,(t + ,s))^QQ^"^(^-^)(r„,i)- (44) 
Also, by Proposition 3.5.2 in [5T] and t H> Q^^'^{t,q) is continuous it holds that 

lim — (3^"fc(r„j^s) = (3"'°(s,g) a.s.. 

Consequently, dividing (j44p by r„^ and taking limits yields that 

Q"'=(i + s) = g"'=(i,Q"''(s)) 
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and hence we have 

^""(• + 5,9)6 J-£(0"^(s,g)). 
This shows the assertion. 

□ 

In the following we consider queueing networks under disciplines that are 
memoryless in the sense that the allocation process T of the fluid limit model 
at a time t does only depend on the queue length at that time t. In particular, 
it docs not require information of the past. In terms of the fluid limit models 
described in [12] this means that only the fluid level at a given time is needed to 
describe the evolution of the fluid level process. Note that this explicitly excludes 
a number of disciplines as e.g. FIFO networks. We will comment on FIFO fluid 
networks in Section [H] We also note that the problem of concatenating fluid 
limits was also addressed by A. Stolyar [32] and Ph. Robert [5S1 Section 9.2.3]. 
In |32| it is shown that if the queueing disciplines in every station satisfy a 
certain 'uniqueness condition' on the disciplines of the individual servers the 
concatenation property holds. However, there the definition of state is different, 
because the state as used in [32 includes the past trajectory of the queue. 
Furthermore, in [28] concatenation is possible if the fluid limits going through 
a certain queue level Q are unique. 

Remark 6.3. Consider a queueing network with a memoryless discipline. We 
conjecture that in this case the fluid limit model Ql satisfies the concatenation 
property. Unfortunately, this claim has shown some resilience towards attempts 
of proof 

Due to fact that Ql is closed by definition we would obtain the following 
result. 

Conjecture The fluid limit model of a "memoryless" discipline defines a GFN 
model satisfying (e). It is stable if and only if it admits an upper semicontinuous 
Lyapunov function. 

The conjecture holds true for the systems considered in [28], but unfortu- 
nately, the interesting fluid limits do not have unique paths. As to the question 
of under which conditions fluid limit models satisfy condition (f) we dare not 
venture a conjecture. 

7 The linear Skorokhod problem 

Another possible way to approximate a multiclass queueing network is to con- 
sider the so called diffusion limit. This limit can be regarded as a semi- martingale 
reflected Brownian motion (SRBM). Similar to the fiuid limit, a sufficient con- 
dition for the stability of the SRBM is the stability of the linear Skorokhod 
problem (LSP) [TH]. The following description is taken from [5] and [31]. Let R 
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be a J X J matrix, gR-^ and Zq e R^. The pair {Z{-),Y{-)) G C(M+,R:[) is 
said to solve the LSP (6*, R) with initial state Zq, if they jointly satisfy 

Z{t) = ZQ + 0t + R y (<) > 0, (45) 
Y{Q) = and Y{-) is nondecrcasing, (46) 

/>oo 

0= / Z,(i)dy,(t), i = l,...,J. (47) 
Jo 

The first question that arises is, which conditions guarantee the existence of 
a solution of the LSP (6', R). In oder to state such a condition recall that a J x J 
matrix R is said to be an S'-matrix, if there exists an a; > such that Rx > 0, 
and is said to be completely-S' if all of its principal submatrices are S'-matrices. 
The following theorem from [4l Theorem 1] contains the desired statement. 

Theorem 7.1. The LSP(d,R) has a solution (Z{-),Y{-)) if and only if the 
matrix R is completely-S . 

Analogous to the previous subsections we define 

Qlsp = {Z{-) : 3Y{-) such that {Z{-),Y{-)) satisfy (gS]) - gT])}. 

Note that Theorem 17.11 states only the existence of a solution. In general 
the solution is not unique, for a counterexample see e.g. 

Definition 7.2. A LSP{6, R) is said to be stable if for any number e > and 
any Z{-) £ Qlsp with \\Zq\\ = 1, there exists a t > such that \\Z{t + •)|| < e. 

To ensure that the set Qlsp is nonempty, Theorem 17. II states that R has to 
be completely-5'. In |M1 Theorem 5.2] it is shown that in this case Definition l7.2l 
is equivalent to Definition 12.21 To derive a necessary and sufficient condition for 
stability of the linear Skorokhod problem we have to show that Qlsp is a strict 
GFN model. The next lemma from [IJ Lemma 1] or [331 Lemma 5.1] implies 
that Qlsp satisfies the Lipschitz condition. 

Lemma 7.3. // the matrix R is completely-S , then there exists a constant M 
such that any solution (Z{-),Y{-)) of LSP{0,R) is Lipschitz continuous with 
constant M . 

The fact that Qlsp is closed follows from Proposition 1 in [3]. Furthermore 
that the scale, shift property hold is stated in [501 Section 2]. So it remains to 
investigate whether Qlsp satisfies the concatenation and the lower semiconti- 
nuity property. Again we bring the linear Skorokhod problem into the context 
of differential inclusions. That is, let Y{t) = u and 

G{Z) = {e + Ru:ue Ulsp{Z)} , (48) 

where the set of admissible controls Ulsp is determined through the condi- 
tions 
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M > 0, Zj Uj =0, V = 1, J. 



(49) 



While it is clear that the set described by P^j) is unbounded on the bound- 
ary of the positive orthant, Lemma [7.31 may be used to see that the effective 
set of controls is bounded. Indeed from the Lipschitz continuity of solutions, 
only values of u below a certain bound need to be considered in (|48p. The 
corresponding differential inclusion is of the form 

Z{t) e G(Z(i)), Z{Q) = Zo. (50) 

It can can seen that the right-hand side is upper semicontinuous and the set 
G{Z) is convex and compact. Again arguments from the theory of differential 
inclusions show the validity of the concatenation property. 

Theorem 7.4. Qlsp is a closed GFN model satisfying (e). It is stable if and 
only if it admits an upper semicontinuous Lyapunov function. 

We note that it is not obvious whether the right-hand side is also lower 
semicontinuous . 

Remark 7.5. The consequence of the above theorem is, that the main theorem is 
applicable for the linear Skorokhod problem. However, for the provided Lyapunov 
function we can only show upper semicontinuity. 

8 Remarks on fluid networks under FIFO ser- 
vice discipline 

For fluid networks that work under the FIFO service discipline the fluids are 
served in the order of their arrivals. To describe the evolution of class k fluids 
we have to consider the workload W{t) = C Q{t) of the station j = s{k). 
For any time t all jobs that arrive later than t have lower priority in the FIFO 
discipline. So fluids that arrive at time t are served at time t + Wj{t). The 
total arrivals of each fluid class until time t is A{t) = at + P'^ MT{t). The 
characteristic of a FIFO fluid network can for each class k G {i,...,K} be 
represented by the following relation 

n{t + W,{t))^mk{Qm + Ak{t)), (51) 

where = l^k^- Note that the fluid network is not completely determined by 
the initial fluid level (3(0) as it has to specified in which order the initial fluid 
level is served in the time period [0, Wj(0)]. So the initial data for each class 
/c G /C is given by 

{n{s) : se [0,I¥,(0)]}. 
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The dynamics of a fluid network under FIFO service discipline is given by 
([22|) - ((25)) and ((5T|) . Analogously to the previous disciplines we denote 

Qp = {Q{.) : 3T(-) such that {Q{-),T{-)) is a solution (HH) - (HH) , (gT]) } . 

In [331 Lemma 3.7] it is shown that Qi? is a closed GFN model. However the 
fluid networks under FIFO discipline differ from the previous fluid models. One 
reason for this is the following. Consider again the flow balance equation in 
differential form, i.e. 

Q{t) =a-{I - P^)Mf{t). 

In the FIFO case the allocation process has to satisfy a functional differential 
equation of neutral type PBI, since the allocation process has to satisfy the 
differential form of condition (|51l) 

K 

tk{t + Wj{t)) (1 + Wj{t)) = muak - TOfc J2P^kMt). 

1=1 

The second reason is given two paths Qi{-) and Q2{-) of Qf that coincide at 
some time, they will in general have different history, so that the concatenation 
is not immediately possible. In this context the initial data {Tfc(s) : s G 
[0, Wj(0)] } plays a key role. An explicit counterexample to the concatenation 
property for FIFO networks my be found in [50] . 

9 Conclusion 

In this paper we have derived a converse Lyapunov theorem for generic fluid net- 
works under a concatenation condition. Continuity of the Lyapunov function is 
ensured if the solution set of the fluid network has a a lower semicontinuity prop- 
erty. Continuity is of interest because this would ensure robustness properties 
of the network subject to unknown parameters or external perturbations. The 
interesting class of FIFO networks does not immediately fall under the results 
presented here. The question of a Lyapunov theory for this and related cases is 
the subject of ongoing research. 
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